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(1961)),  there  exist  n  elements  . . .  In  H  called  the  representers.  Knz  has  the  representation 


this  Is  reasonable,  since,  loosely  speaking,  /K(t1 ,s)f(s)ds  and  /K(t^,s)f(s)ds 
can  be  expected  to  be  less  linearly  Independent  on  smooth  functions  than  on 
arbitrary  elements  of  L9. 


P(tj.tk).  P  is  a  Green's  function  for  *  4th  order  linear  differential 
operator,  thus  the  eigenvalues  of  the  Hilbert  Schaidt  operator  with 


5 


the  generalized  cross  validation  function  (GCVF)  V(x)  defined  by  The  predictive  mean  square  error  T(x)  is  defined  by 


compares  the  true  and  estimated  second  derivative.  It  can  be  seen  that 
the  results  are  very  good. 


Figure  J •  Eatlcatlon  of  Second  Derivative 
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Ue  give  a  generalization  of  the  6CV  method  for  choosing  x  in  these  Suppose  that  Kfn  x(tfc)  considered  as  a  function  of  is  twice 

constrained  regulariation  methods  and  discuss  some  computational  strategies  continuously  differentiable  in  the  neighborhood  of  z^.  Then,  it  is  shown 

for  fairly  general  C.  We  omit  discussion  of  the  case  ||-||  is  a  semi  .  in  the  appendix  that  one  can  expand  KfR  x(tk)  In  a  Taylor  series  about 

norm,  see  Wahba  (I979d)  for  some  further  details  in  that  case.  z.  and  obtain 


Inferior  properties  to  GCV,  See  6HW, 


,d4+nX'  theory,  see  Wahba  (1973).  Then,  f  the  iilnlwlzer  of 


but  we  do  not  pursue  this  further  here. 
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The  nodal  Zj  ■  ^K(t|,s)f(s)ds  ♦  c1,  1  ■  1,2 . .  Is  studied,  where  R  is 

assueed  known,  the  Uj }  are  randan  errors,  end  It  Is  desired  to  estlnete 

f  fron  the  data  (2j).  The  (regularized)  estlnete  of  f  will  be  taken  as 

the  nlnlnlzer  In  H  of  •  £(Hf)(t|)-S|)1  ♦  A||f||*  (■(•)),  where  H  Is  a 

reproducing  kernel  space  with  norm  ||'||.  Me  first  define  the  Intrinsic 

rank  of  this  experlnent.  This  definition  Is  used  to  provide  Insight 

Into  the  cl rc instances  In  which  one  nay  expect  to  estlnete  f  well, 

noderate  1y  well,  or  poorly.  The  sensitivity  of  a  regularized  estlnete 

to  the  Uj)  Is  oade  explicit.  After  giving  the  Intrinsic  rank  of  the 

examples  of  first  end  second  derivative,  Abel's  equation  and  FuJIta's 

equation.  It  Is  argued  that  the  first  three  are  only  nlldly  111  posed 

and  If  f  Is  “nice*  It  will  be  anenable  to  accurate  estinatlon.  The  nethod 

of  generalized  cross  validation  for  choosing  A  Is  reviewed  and  nwnrlcal 

results  for  the  estinatlon  of  first  and  second  derivative  fron  noisy  data 

are  given.  A  nethod  for  solving  Abel's  equations  when  Inversion  forvulae 

are  available  is  described  which  exploits  properties  of  the  above  Mentioned 

first  derivative  estlnate.  The  use  of  outside  infornatlon  In  the 

estinatlon  of  f  Is  then  considered.  Me  consider  the  cases  where  f  Is 

known  to  satisfy  a  finite  mnfter  of  linear  equality  constraints  (for 

exanple,  boundary  values,  or  nonent  conditions)  or  a  continuous  fanlly 

of  linear  Inequality  constraints  (Including  positivity,  nonotonlclty  or  convexity). 

f  is  then  estlnated  by  nlnlnlzlng  or  approxlnately  nlnlnlzlng  (*),  subject  to 

these  constraints.  Me  extend  the  generalized  cross  validation  nethod  for  choosing 

X  to  this  case.  Finally,  the  extension  of  this  nethod  to  certain  robust 

estinatlon  problem  Is  suggested. 
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